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We study two types of simple Boolean networks, namely two loops with a cross-link and one loop 
with an additional internal link. Such networks occur as relevant components of critical K = 2 
Kauffman networks. We determine mostly analytically the numbers and lengths of cycles of these 
networks and find many of the features that have been observed in Kauffman networks. In particular, 
the mean number and length of cycles can diverge faster than any power law. 
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1. INTRODUCTION 

The study of random Boolean networks is of great in- 
terest since these networks are one of the simplest models 
of genetic regulatory networks. Although they were in- 
trocuded already 40 years ago by Kauffman [1], they are 
still poorly understood. Due to increasing computational 
power, it was recently discovered that old assumptions 
about the properties of the cycles of these networks have 
been wrong, see [2-4]. To better understand Boolean 
networks is an important requirement before being able 
to study successfully more realistic, but also more com- 
plicated models. 

Random Boolean networks are directed graphs con- 
sisting of N binary nodes, each having inputs from K 
randomly chosen other nodes. To each node, a Boolean 
function is assigned that gives the updating rule of the 
node as function of input values. The network is updated 
synchronously, and starting from an initial state, the net- 
work eventually reaches a periodic trajectory (a cycle). 
The situation K = 2 is particularly interesting since it 
is the critical point between the ordered regime (where 
only a finite number of nodes are not frozen for N — > oo) 
and chaos (where a small perturbation spreads through 
the entire network). For this reason, it was believed for a 
long time that the number and mean length of cycles of 
critical networks increases as a power law with network 
size N. However, recent computer simulations [2] as well 
as analytical calculations [5] indicate that the number of 
cycles of critical Boolean networks increases faster than 
any power law with N. So far, none of these studies pro- 
vides direct intuitive insights in how this feature emerges 
from the network structure. Additionally, there is yet 
little agreement on the behavior of the mean length of 
cycles. 

This work aims at understanding better how such vast 
numbers and sizes of cycles can emerge. For this purpose, 
we refer to the concept of relevant nodes introduced in 
[6]. These are those nodes of the network that can in- 
fluence themselves via a loop of connections. Their state 
undergoes therefore a nonconstant sequence of values at 
least on some cycles. The network that remains after 
removing the irrelevant nodes consists only of loops and 
links between and inside loops. Most nodes are frozen [7], 



and recent work [2] suggests that the number of relevant 
nodes increases as TV 1 / 3 with the number of nodes. The 
reduced network that contains only the relevant nodes 
determines the number and lengths of cycles in the full 
network. It has only slightly more than one input per 
node. However, little is yet known about the number of 
cycles even on the simplest possible relevant networks, 
apart from simple loops. We therefore focus in this ar- 
ticle on the cycles of two of the simplest relevant net- 
works (or building blocks of relevant networks) that can 
be constructed, namely two cross-linked loops and one 
loop with an additional link within the loop. We shall 
see that the mean number of cycles on these simplest rel- 
evant networks increases faster than any power law with 
the number of nodes of these networks, and for some 
of these networks also the mean cycle length increases 
faster than any power law. Since it can be expected that 
these simple networks occur within the relevant network 
of critical Boolean networks, we now understand better 
properties of cycles in critical networks. 

The outline of this paper is as follows: In the next sec- 
tion, wc briefly review the properties of cycles on simple 
loops. In section 3, we study the cycles of two cross- 
linked loops. In section 4, we focus on loops with one 
additional link, and in the final section, we discuss our 
results. 



2. SIMPLE LOOPS 

Trivial loops consisting of N nodes are the simplest 
networks. Each node has one input, just as in a K = 1 
network, and the nodes are connected to form a loop. 
Since we are only interested in systems consisting of rel- 
evant nodes, we consider the case where out of the 4 
possible Boolean functions only the two nontrivial ones 
occur. These are "truth" , which simply copies the value 
of the input at the update, and the Boolean negation. 

A loop with n negations can be mapped bijectively 
onto a loop with n — 2 negations by replacing the two 
negations with truth and by inverting the state of all 
nodes between these two links. For this reason, we need 
to consider only loops with zero negations and loops 
with one negation. We refer to these two situations as 
the "even" and "odd" case respectively. The dynam- 
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ics on these loops has the following obvious properties, 
see also [8], [9]: 

1. After N updates, a loop with an even number of 
negations returns to the same state. A loop with 
an odd number of negations returns to the same 
state after 2A updates. 

2. Consequently, each state is on a cycle, and the 
mean cycle length, multiplied by the number of cy- 
cles, is 2 N . 

3. No cycle can be longer than N (even) or 2 A (odd). 
Loops with zero negations have 2 fixed points (all 1 
or all 0), and loops with one negation have a cycle 
of length 2 (alternating and 1). 

4. If A is a prime number, the number of cycles is 
given by 

„ 2 + even case H N 

1 + ^2iv^ odd case 

This result does not apply to an odd two-node sys- 
tem A = 2. In this case, there is one cycle that 
comprises all 4 states. 

5. If A is not a prime number, any divisor of A (2A) 
is also a cycle length. There exist more shorter 
cycles, and therefore the number of cycles is larger 
than the above expression. 

To summarize, simple loops have a mean cycle length of 
the order of A, and an average number of cycles that 
increases as 2 N /N, which is faster than any power law in 
A. 



3. TWO LOOPS WITH CROSS-LINK 

We next consider two loops of size Ai and A2 with 
a cross- link (see Fig. 1). We denote with E the node 
with two inputs, and with G\ and G2 the two nodes it 
receives its input from. Again, we consider only the case 
where all links are relevant. Without loss of generality, 
the first loop has only truth functions or one negation. 
The second loop has truth functions at all nodes apart 
from E, and one of the following three Boolean functions 
at E: fu, which is if and only if Gi =0 and G2 = 1; /u, 
which is if and only if both its inputs are 0; and finally 
the function fg, which takes the value G2 if Gi = 1 and 
the inverted value of Gi if G\ = 0. The first two functions 
are canalyzing functions. This means that there exists 
at least one input configuration for which inverting one 
input does not change the output. The third function is 
reversible, since to each state the network has a unique 
predecessor. Each state of the system is therefore on 
a cycle, and the mean cycle length, multiplied by the 
number of cycles, is 2 Nl+N2 . The other four canalyzing 
functions and the second reversible function need not be 




FIG. 1: Two loops with a cross-link. 



considered, since networks with these functions can be 
mapped on networks with the given three functions by 
inverting the states of all nodes in the first loop, or by 
inverting the states of all nodes. 



A. Case 1: Ni and N2 are prime numbers 

In the following, we focus on the case that Ai and 
A2 are prime numbers (with Ai 7^ A2). The first loop 
provides a periodic input to E of the period p\ = N\ 
or 2Ai or 1 or 2. Loop 2 behaves like a single loop, 
where the Boolean function at E changes between truth 
and negation (/g) according to a pattern of period pi, 
or between negation and 1 (/11), or between truth and 
1 (/14). Loop 2 returns to the same state no later than 
after 2p\N 2 updates. The largest cycle has therefore the 
length 4A1A2 (except for A2 = 2, where the largest cycle 
has the length 4Ai ) . 

If the Boolean function at E is canalyzing, most results 
can be derived from the observation that for p\ > 1 the 
first input to E is 1 every 2Ai time steps, and possibly 
more often. Let us first consider the function /14. A 1 
at G2 will lead again to a 1 at G2 after 7JA2 updates, 
for any integer n. A at G2, combined with a at Gi, 
will lead to a at G2 after A2 updates. However, at the 
latest after n = 2N\ update cycles of length A2, this 
will become a 1. Therefore, loop 2 will be frozen to all 1 
after this time. The cycles of the network have length p\ 
if pi > 1. If pi = 1, we obtain cycles of length A2 and 1. 
We conclude that if there is a function /14 at E and no 
negation in loop 1, the system has (2 N2 — 2)/A2 cycles 
of length A 2 , three cycles of length 1 and (2 Nl - 2)/N l 
cycles of length N\ . If there is a function /14 at E and 
one negation in loop 1 , we have one cycle of length 2 and 
(2 Nl - l)/2Ai cycles of length 2Ai. 

Next, let us consider the function /n at E. If p\ = 1 
and loop 1 is in state 1, the entire system is frozen in state 
1. If loop 1 is in state 0, loop 2 is like an independent 
loop with one negation. If p\ = 2, the entire system has 
period 2. If p\ = N\ or 2Ai, the first loop enslaves the 
second loop, completely determining its state and wiping 
out every memory of its initial state. Consequently, the 
cycle length is Ai (2Ai) for an even (odd) first loop. 
We conclude that if there is a function fu at E and no 
negation in loop 1, there is one cycle of length 1, one 
cycle of length 2, (2 N2 - 2)/2N 2 cycles of length 2N 2 , 
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and (2 Nl — 2)/N\ cycles of length N\. If loop 1 has one 
negation, there is one cycle of length 2 and (2 Nl — 2) /2N\ 
cycles of length 2N\. 

To summarize so far, the number of cycles for a sys- 
tem with N\ and N 2 being prime numbers and with a 
canalyzing function at E is 
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(These equations are modified if one of the loop sizes is 
N = 2. The terms with 2Ni in the denominator then 
have to be dropped.) For large N± and N 2 the mean 
number of cycles grows as 2 jVmax /iV max with -/V max being 
the larger of the two loop sizes, and the mean cycle length 
increases linearly with N max . 

Finally, let us consider the function fg at £. If an even 
loop 1 is frozen in state 1 (0), loop 2 behaves like an 
even (odd) independent loop. We get 2 fixed points (one 
cycle of length 2) for the entire network and (2 N2 — 2) /N 2 
cycles of length N 2 ((2^ - 2)/2A 2 cycles of length 2N 2 ). 
If an odd loop 1 is on the cycle of length 2, the two loops 
have one cycle of length 4 and (2 N2 — 2)/2N 2 cycles of 
length 4iV 2 

If loop 1 has period p\ = N% > 1 with an even num- 
ber of 0s, the state of G 2 will be the same every N\N 2 
time steps. For a given cycle with period iVi on loop 1, 
two cycles with period N± of the entire system can be 
constructed in this case as follows. Begin by fixing the 
initial value of one node in loop 2. After one time step, 
the next node on loop 2 (in clockwise direction) will be 
the one that is fixed, etc. Update the system for N± time 
steps and observe the value that will be fixed then, and 
choose this to be the initial state of that node. After it- 
erating this procedure N 2 times, one has fixed the initial 
state of all N 2 nodes, and one returns to the initial node. 
Due to the even number of zeros on loop 1, the initial 
node will then have again its initial value. We have thus 
created an initial state that lies on a cycle of length N\ . 
A second cycle of length Ni is created by starting with 
the second possible initial value. All other cycles have 
the period NiN 2 . 

If loop 1 has period p% > 1 with an odd number of 0s, 
which is always the case for an odd loop 1, the state of 
G 2 will be the same every 2p\N 2 time steps. For a given 
cycle with period p\ on loop 1, a cycle with period 2p\ of 
the entire system can be constructed as above, since two 
subsequent periods of loop 1 have an even number of 0s. 
The other cycles have length 2N 2 p\. 

Our considerations lead to the following numbers and 
lengths of cycles in systems with a reversible function at 
E: 
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for an even loop 1, and 
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for an odd loop 1. (Again, the results are modified if a 
loop has size 2. For JVi = 2 and an even loop 1, there is 
no cycle of length Ni or Ni N 2 , and the cycles of length 
2Ni and 2N\N 2 occur twice as often. For an odd loop 
1, the first two columns vanish, and the other two cycle 
numbers are doubled. For N 2 = 2 and an even loop 1, 
column 3,5,7 vanish, the cycle numbers in column 4,6,8 
are doubled. For an odd loop 1, column 1 and 3 vanish, 
and the other cycle numbers are doubled.) 
The mean number of cycles diverges as 
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and the mean cycle length increases as N\N 2 . Apart from 
the prefactor, this result is the same as for two uncoupled 
loops. 



B. Case 2: Ni = N 2 = N 

We call this case "resonant" , because here one has sub- 
stantially more cycles for canalyzing fs in comparison to 
the case Ni 7^ N 2 with N\ , N 2 of the same order of mag- 
nitude. Since each node value of loop 2 can be changed 
at £ by exactly one node value of loop 1, the system can 
be decomposed into N independent systems of 2 nodes, 
where the first node receives input from itself (negation 
for an odd loop 1, otherwise truth function), and the 
second node receives input from both nodes. These N 
systems are updated one after another. If the first loop 
is even and the Boolean function at £ is /14, the 2-node 
system has three cycles of length 1. The complete system 
has therefore 3 cycles of length 1 and ~ — 5jy,2 cycles 
of length N. 



If the first loop is odd and the Boolean function at 
£ is /14, the 2-node system has one cycle of length 2. 
The complete system has therefore one cycle of length 2 
and 2 ~ 2 cycles of length 27V. The first loop enslaves 
the second loop. (For N = 2, there is only one cycle of 
length 4.) 

If the first loop is even and the Boolean function at E 
is fn, the 2-node system has one cycle of length 1 and 1 
cycle of length 2. The complete system has therefore one 
cycle of length 1, one cycle of length 2, and 2N cycles 
of length 2N. (For N = 2, there are only two cycles of 
length 4.) 

If the first loop is odd and the Boolean function at 
E is /n, the first loop enslaves the second loop. The 
complete system has therefore one cycle of length 2 and 
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2 2 ~ 2 cycles of length 2N . (For N = 2, there is only one 
cycle of length 4.) 

If the first loop is even and the Boolean function at £ is 
/g, the 2-node system has two cycles of length 1 and one 
cycle of length 2. The complete system has therefore two 
cycles of length 1, one cycle of length 2, N cycles of 

length N (none for N = 2), and 4 " ~ 2 (3 for N = 2) 
cycles of length 2N. 

If the first loop is odd and the Boolean function at £ 
is fg, the 2-node system has one cycle of period 4. The 
complete system has therefore one cycle of period 4 and 

4 x cycles °f period AN. (For N ~ 2, there are only 
two cycles of length 8.) 

For large N, the number of cycles diverges as 
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for an even or odd first loop, and the mean cycle length 
increases linearly in N. Our computer simulations are in 
agreement with the analytical results. 



C. Case 3: General Ni and N 2 

If Ni and/or N 2 are not prime numbers, there are more 
cycles. First, let us consider the case that N\ and N 2 
have no common divisor and that loop 1 is even if N 2 is 
even. The above listed cycle lengths 1, 2, Ni, N2, 2N\, 
2N 2 , 4AT 1; AN 2 , N X N 2 , 2N 1 N 2 , W±N 2 still occur, but 
there exist additional cycle lengths, which are obtained 
by replacing N\ and/or N2 with one of its divisors. The 
numbers of cycles with lengths from the list will decrease 
accordingly. 

In the remainder of this section we consider the more 
interesting case that the cycle length of loop 1, Pi, and 
N2 have a greatest common divisor g = g{P\) > 1. This 
is always the case if N\ and N2 have a common divisor. 
The special case N\ = N2 was treated in the previous 
subsection. 

The least common multiple of Pi and N 2 is PiN 2 /g 
and, for a given Pi, the largest possible cycle length is 
2PiN2/g and the smallest possible cycle length is P\. 
The values of one period of loop 1 and the nodes of 
the second loop split into g independent subsystems with 
P\ I g values in each periodic sequence from loop 1 at Gi , 
and N2I g nodes from the second loop. One subsystem is 
updated at a time and takes place of the next one in the 
sequence. For a handy picture of the subsystems one can 
imagine the sequence of period Pi/g as being produced 
by an even loop with Pi/g nodes. In the case of an odd 
loop 1 and an even Pi/ g, the second half of the period of 
such a new loop 1 in a subsystem is the inversion of the 
first half. In the case of an odd loop 1 and an odd P\jg 
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FIG. 2: Three examples of numerical results for the number 
of cycles as function of their length for two loops with a cross- 
link, with an even first loop 



the subsystems come in pairs; to each subsystem with an 
odd number of Os in the periodic sequence from loop 1 
there exists a subsystem with an even number of Os. The 
Os and Is arc interchanged. We call these subsystems 
complementary. 

The numbers and lengths of cycles of a subsystem can 
be calculated according to the rules outlined in the pre- 
vious subsections. Let us now point out some rules that 
help determining the possible cycle lengths of the entire 
system if the cycles in the subsystems are given, their 
lengths be denoted by pi,p 2 , . . . . If each subsystem is 
on a different cycle, the cycle length of the entire system 
is T = LCM(p 1 g,p 2 g, . . .). LCM stands for the least 
common multiple. Otherwise shorter cycles can exist. 
For example, if all subsystems are on the same cycle, 
Pi = p 2 = ■ ■ ■ = p, the phase shifts between subsystems 
can be arranged in such a way that overall periods shorter 
than pg occur. These periods can be any divisor of pg 
that is a multiple of p, but not a multiple of g. 

Now, let us turn to the number of cycles. We first 
consider the reversible Boolean function fg at S. If Ni 
and are large and for an even first loop, it is suf- 
ficient to consider Pi = Ni, so that each subsystem is 
approximately with probability 0.5 on a cycle of length 
Ni/g ■ N 2 /g and with probability 0.5 on a cycle of length 
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Ni/g ■ 2N2/g. The subsystems are almost certainly on 
different cycles. The probability that the overall cycle 
length is NiN2/g is 0.5 9 , and the probability that the 
overall cycle length is 2AqA r 2/<? is (1 — 0.5 9 ). We can 
neglect the cycles of length NiN 2 /g, since their number 
is 0.5 9 /(l — 0.5 9 ) times smaller than that of the cycles 
of length 2NiN2/g. The next neglected contributions 
to the number of cycles would be from cycles of lengths 
2N 2 ,N 2 ,2N 1 ,N 1 . 

If the first loop is odd, we can restrict ourselves to 
looking at Pi = 2Aq. Each subsystem or each pair of 
complementary subsystems is with probability near to 1 
on a cycle of length 2 • 2N\/g -N 2 /g, and the overall cycle 
length is 4NiN 2 /g. In our estimation for the number of 
cycles the most significant contributions we neglect come 
from cycles of lengths 2P\ with Pi = 2 Aq and 4N 2 j g with 
Pi = 2. Equation (3) for the mean number of cycles for 
large Ni and N 2 becomes now 
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For canalyzing Boolean functions, there is now a big 
difference between the case of an even loop 1 and an odd 
loop 1. If loop 1 is odd for odd N 2 it always enslaves 
the second loop, and the value of N 2 does not matter. 
We obtain no new results beyond what has been written 
in the previous subsections. The majority of cycles have 
length 2Ni. Their numer is of the order of 2 Nl /2N 1 . 
We obtain this and the following results systematically 
by combining the results for individual subsytems. For 
instance, for even N 2 and Pi = 2 one of the two subsys- 
tems is all 1 and the other one is all 0. For the function 
/ 14 at £ we then get of the order of 2 N2 / 2 /(N 2 /2) cycles 
of length N 2 . For f n we get of the order of 2 N2 / 2 /N 2 
cycles of length 2N 2 . 

For an even loop 1 the change in cycle size and number 
is dramatic compared to the case where Aq and N 2 are 
prime numbers. In particular, cycles of lengths N1N2/ g 
and 2NiN2/g appear now, since some subsystems may 
have the period Ni/g and some subsystems the period 
N 2 /g. Let us first consider the function /14. For large 
Aq and N 2 , each subsystem is almost certainly in one 
out of approximately 2 Nl ^ 9 states belonging to cycles of 
length Ni/g or in one out of 2 N2 ^ 9 states belonging to 
cycles of length N 2 /g. The number of cycles for large Aq 
and A^2 is therefore 
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A more detailed treatment leads to the following expres- 
sion for this quantity 
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FIG. 3: A loop with an additional link 



where the dominant cycles of the lengths NiN 2 /g, Aq 
and A2 have been taken into accout. 

Finally, let us consider the Boolean function fn. If 
Ni/g is even, the longest cycle length is AqA^/g, other- 
wise it is 2NiN 2 /g. We have therefore 
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As an illustration of the findings of this subsection, we 
show in figure 2 the results of three numerical evaluations 
of the cycles of a two- loop system with g = 5. Com- 
pared to two independent loops, for which the largest 
cycle length is N\N 2 /g, the largest cycle can now have 
up to four times this length. When the Boolean function 
at £ is canalyzing, the cycles are comparatively shorter 
and there are more of them. In any case there exist char- 
acteristic dominant cycle lengths. The total number of 
cycles increases faster than any power law with Aq and 
A r 2, but the mean cycle length increases linearly in Aq 
and A2. 



4. LOOPS WITH ONE ADDITIONAL LINK 

Now let us turn to a loop of size N = L + M + 2 with 
one additional link, as shown in figure 3. We denote with 
E the node with two inputs, and with Gi and G2 the two 
nodes it receives its input from. Again, we consider only 
the case where all links are relevant. Without loss of gen- 
erality, we can assume that the Boolean functions at all 
nodes apart from S are truth functions. At S, we shall 
consider the reversible function fg, and the canalyzing 
functions /14, fn, f±, and f±. f± is if the input from 
Gi is 1, and otherwise it copies the values of the second 
input, fi yields 1 if and only if both inputs are 0. Sys- 
tems with the other Boolean functions can be mapped on 
systems with these functions by inverting the states of all 
nodes. We count the nodes counterclockwise, assigning 
to G2 the index x = 1, to Gi the index x — L + 1, and 
to £ the index x — N = 0. 
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A system with n < L nodes on the connection from 
Gi to E can be mapped on the system shown in figure 3 
by connecting node number L + 1 — n directly to E. In 
the following, we will first consider the four canalysing 
functions, and then the reversible function. We will use 
analytical calculations as well as computer simulations. 



A. Case 1: Boolean function /14 at E 
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We first consider the simplest case, where an output 
is only obtained if both inputs are 0. Starting from a 
random initial condition, the initial number of 0s cannot 
increase. There are two fixed points, all and all 1. 
Every needs another L steps back along the loop 
links in order to survive. Nontrivial cycles occur only 
if the greatest common divisor of N and L is g > 1. 
There are then g independent sets of nodes, which can 
be assigned a value or 1. There are 2 9 — 2 states on 
cycles of length g or one of its divisors. The number of 
cycles, averaged over L and over a small interval of N 
values increases at least as 2 N / 2 /N 2 with N, since for 
even TV and L = N/2 we have g = N/2. 



B. Case 2: Boolean function ft at E 

The next canalyzing function we consider yields a if 
the first input is 1, and copies the value of the second 
input otherwise. Starting from a random initial condi- 
tion, each node value comes back to the starting loca- 
tion without change after one rotation (i.e., after N time 
steps). On a cycle, each 1 at G2 must be followed by a 
at Gi, L nodes back, otherwise it would disappear as 
it passes E. Let us consider the sequence of states of G2 
every L time steps on a cycle. If g is the largest common 
divisor of L and N, there are g independent sequences of 
length N/g. For the number 4>n of different sequences of 
period N, where each 1 is followed by a 0, one obtains 
the recursive equation 



t>N-l + 4>N-2 , 



since a sequence of length N can be obtained by adding a 
after the first 1 of a sequence of length N —1 (or at the 
end, if there is no 1) or by adding a 01 after the first 1 of 
a sequence of length N — 2 (or a 00 at the end, if there 
is no 1). The initial condition is <f>i = 1 and <p2 = 3. For 
large N, we make the ansatz cf>N = a ■ b N , which leads to 
b = (1 + V5)/2. For 2 < N < 20, we find numerically 
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no common divisor, we expect the number of cycles to be 
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Otherwise, the number of cycles is somewhat larger. 
These results are confirmed numerically, as shown in fig- 
ure 4, where averaging over different L has been per- 
formed. 



FIG. 4: Mean number of cycles per network for the canalyzing 
function fi at E. 



C. Case 3: Boolean function /1 at E 

Now we continue with a more complex case: the cana- 
lyzing function f\ yields 1 if and only if both inputs are 
0. Consequently, if one of the two inputs is 1, the output 
is 0. We will sec that there arc again exponentially many 
cycles. 

First, let us consider the fate of a node value 1 on a 
cycle as we iterate the network. This 1 moves from site 
x to site x — 1 during one time step. As it reaches the 
node Gi, it produces a at E. When it reaches G2, it 
produces another exactly L sites behind the first one. 
These two zeros will produce a value 1 as soon as they 
reach the nodes G\ and G2 respectively. Thus, a 1 comes 
back to its original place after 2N — L steps. In the same 
way, each pair of 0s, L steps apart from each other, will 
come back to their original places after 2N — L steps. 
One can easily see that every on a cycle must be a part 
of such a pair: consider a 1 that has just been created 
at site E. If after L time steps there is a at E, there 
must be at the same time a 1 at Gi . After L additional 
time steps, there is consequently a at E. We conclude 
that the period of the cycles is 2N — L or one of its 
divisors. For L = 1, the number of cycles is equal to the 
number of sequences of length N, where 0s always occur 
in pairs, with an appropriate boundary condition at E. 
The number of such sequences 4>n satisfies the recursion 
relation 



4>N = 2(j) N -i - 4>N-2 + <pN-3, 



N > 4. 



(10) 



This relation can be explained as follows: A sequence of 
length N is constructed by inserting a 1 or a after the 
first 1 in a sequence of length N— 1 (giving (f>N = 20at_i). 
If there was another 1 after the first 1, insertion of a 
is forbidden. The number of such forbidden sequences is 
4>n-2i since they are obtained by inserting a 1 after the 
first 1 in a sequence of length 4>n-2- Wc therefore have 
to subtract 4>n-2- In order to construct sequences where 
the first 1 is followed by 001, we insert these 3 bits after 
the first 1 in a sequence of length N — 3. This means 
that we have to add 0N-3- Sequences that contain all 
or one 1 at the end are constructed from the all se- 



FIG. 5: Mean number of cycles per network for the canalyzing 
function /g at E. 

quence of length N — 1 by inserting a or a 1. Taking 
into account the boundary condition, the starting values 
are </>i = 0, (f>2 = 3, </>3 = 5. The approximate solution of 
Eq. (10), valid with the precision of the numerical eval- 
uation for N < 20, is 4> N = 0.75488 exp(0.5624iV). The 
total number of cycles for L = 1 can now be estimated 
as (f>if/(2N — 1). For larger L, the periodic sequence of 
node values at distance L passes the node E L times, and 
the boundary conditions are more involved. We found 
numerically that for large L the factor in the exponent 
is smaller. Figure 5 shows the number of cycles, aver- 
aged over L, obtained using computer simulations. The 
asymptotic increase is not yet visible for these small val- 
ues of N. 



D. Case 4: Boolean function /n at E 

The last canalyzing function that we want to consider, 
produces 1 if the first input is 1 and inverts the second 
input otherwise. This means that the update rule gives 
if and only if the first input is and the second one is 
1. The system has a fixed point with all states being 1. 
Let us consider the fate of a node value 1 on a cycle as 
we iterate the network. This 1 moves from site x to site 
x — 1 during one time step. When it reaches the node G\ 
it produces a 1 at E. Thus, a 1 comes back to its original 
place after N — L steps. Similarly, a comes back to 
its original place after N — L steps, if there was a 1 at 
this place L time steps before. We now show that the 
period of a cycle is indeed N — L (or a divisor thereof) 
by demonstrating that at each site there must be a 1 L 
time steps after a 0. Consider site E, and assume that its 
state is 0. This can only have been produced if there is 
a at site L. L time steps later, there must consequently 
be a 1 at site E. 

In order to estimate the number of cycles, let us con- 
sider the sequence of states at G\ every L time steps for 
N such time intervals. For L = 1 the number of states on 
cycles is equal to the number of these sequences with an 
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FIG. 6: Mean number of cycles per network for a canalyzing 
function at E. 

appropriate boundary condition. Such sequences have no 
two 0s next to each other and their number satisfies the 
recursion relation <pM — 4>n-i + 4>n—2, since a sequence 
of length N can be generated either by adding a 1 after 
the first in the sequence of length N — 1 or by adding 
a 10 after the first in a sequence of length N — 2. The 
recursion relation can be shown to hold for L <C N, only 
a prcfactor of the solution changes. Note that the re- 
cursion relation is identical to the one in the case of the 
Boolean function / 4 . The total number of cycles diverges 
therefore as e a48121Ar /./V, just as before. 

The results for all four canalyzing functions indicate 
that the mean number of cycles per network, averaged 
over all canalyzing functions and values of L, should in- 
crease at least as fast as e°' 5624N /N 2 , since a fraction of 
the order 1/N of all networks of size N have of the order 
of e °- 5624Ar /N cycles. However, this behavior is not yet 
visible for the N values used in our computer simulations 
shown in figure 6. 

E. Case 5: Boolean function /g at E 

If the Boolean function at E is reversible, the dynamics 
on the system is reversible. All states are on cycles. Since 
a network with L < M + 2 maps on a network with 
L > M + 2 under time reversal, it is sufficient to consider 
the case L < M + 2, or equivalently 

1 < L < [N/2] (11) 

Figure 7 shows the time reversed network, with 

L' = M + 2 = N - L 
M' = L-2 (12) 

Negative values correspond to self links. 

If g is the greatest common divisor of N and L, the set 
of all nodes splits into g independent subsystems with 
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FIG. 7: The network corresponding to the time reversed net- 
work in Fig. 3 for a reversible Boolean function at S 
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FIG. 8: Number of cycles within intervals [2" , 2 n+1 ] for a 
reversible Boolean function at E, for selected values of N, 
averaged over the possible values of L. 
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FIG. 9: Mean cycle number and length as function of N. Top: 
The cycle length is averaged over all cycles of all systems. 
Bottom: The mean cycle length is first evaluated for each 
system separately, before averaging over all systems. The 
dashed line is the function 2^. 



N/ g nodes, just as for the canalyzing functions. In con- 
trast to the canalyzing functions, each state is now part 
of a cycle. The most striking finding is that there occur 
now cycles of a length of the order of 2 . Figure 8 shows 
the result of computer simulations for different values of 
N. One can see that for each of these N values, there 
exist cycles of a length close to 2 N . Figure 9 shows the 
mean number and length of cycles function of N. 
The mean cycle number 

L=l 

shows an exponential increase for N values that are not 
prime numbers. The mean cycle length Pn can be de- 
fined in different ways: 

(a) As the mean over all cycle lengths of all systems, 
p(i) _ Sl c n,lPn,l 

With this definition, we obtain 

P { N 1] C N = 2 N . (13) 



This dependence can clearly be seen in the top part of 
Figure 9, where the mean cycle length is largest when N 
is a prime number and when the cycle number is smallest, 
(b) As the mean cycle length of a system, averaged over 

4 2) = ^Pn,l • 

This definition is more physical, since each system should 
be given the same weight. With this definition, the mean 
cycle length increases exponentially for all N, as shown 
in the bottom part of Figure 9. 

A third possible definition of the mean cycle length, 
which assigns to each possible initial state the same 
weight, leads to even larger values. 

The occurrence of extremely long periods in systems 
like these has been known for some time and has been 
used in a certain class of random number generators, see 
[10], the so-called Additive Lagged Fibonacci Generators. 
In these random number generators, a sequence of m-bit 
numbers Xk is generated by the rule 

Xk = x k -p + Xk-p +q mod m . 

Setting m = 1, p = N, q = L, and using the reversible 
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function f§, this rule gives the sequence of bits generated 
at node £ in our network. 



F. General considerations 

We conclude this section by deriving some general re- 
sults for the numbers and lengths of cycles in our simple 
networks. First, we find a lower bound for the number 
of cycles for a loop with an extra link for certain values 
of N. We start with 

C'2L s~iL icy 
2N — L 'JV ' °7V/ A ■ 

The system splits into 2 independent subsystems, and the 
inequality arises because the cycles of the subsystems can 
have several values of the phase difference, if their periods 
have a common divisor. Iterating this equation gives 

°2" N — [^Nol^ L j = °0 — °0 • 

Now, a given value of L occurs with probability 1/A in a 
system of size N, and therefore the mean number of cy- 
cles in a system of size N = 2 u Nq satisfies the inequality 

C N >^(C ) N = 2 AN /N. (14) 

The number of cycles increases exponentially with N. 

Next, we note that we find always an average of one 
fixed point per network. For a canalyzing Boolean func- 
tion at S, we always find an average number of 1 /4 cycles 
of length 2. The first finding can be understood in the 
following way. If we look at the state space and consider 
the ensemble of all networks of size N with all combi- 
nations of update functions, the successor of a state will 
be with equal probability every possible state, includ- 
ing itself. The probability that a state is a fixed point is 
therefore 1/2 N . Summing over all states gives an average 
of one fixed point. 

Now let us consider cycles of length 2. First of all, 
there are no such cycles with reversible update rules. As 
a matter of fact, depending on L, for the inputs of £ 
on a cycle of length 2 there exist only two possibilities: 
they alternately take on the values (0,1) and (1,0) or 
they alternate between (0,0) and (1,1). In both cases 
the output of the reversible function would be constant, 
thus leaving no space for a cycle of length 2. 

We turn to the canalyzing functions. Simulation data 
show that on average every fourth network has a cycle 
of length 2. We want to give two different proofs for 
this. Consider a state . As with the fixed points, the 
statistical probability that g( % > is followed by g^ under 
the dynamics, is 1/2 N . We denote the corresponding 
set of networks that make this transition by Mij. The 
question now is, what is the probability that the state g^> 
returns to g^' in the next step. For the networks in Mij to 
perform the transition i <—> j for fixed i and j the update 
rule at X is fixed for one of 4 input states, thus ruling out 



4 out of the 8 canalyzing Boolean functions. Thus the 
probability, that Mij leads to g^> at the next time 
step is 4/(8 • 2 N ). Altogether we get the following result 
for the probability p2 of a cycle of length 2: 

^ = ^E^v^v =1 /4 ( 15 ) 

i,j 

We can also see this directly, by constructing ex- 
plicitely the cycles of length 2. These cycles are sequences 
of alternating and Is, which have two 0s (or two Is) to- 
gether at £ for odd Ns. Without loss of generality, we 
use only truth functions as update rules at nodes with 
one input. £ has either inputs alternating between 0, 1 
and 1, for odd L, or inputs alternating between 0, and 
1, 1 for even L, and the output must be alternating 0s and 
Is. In each mentioned case, for any fixed N and L, two 
of eight canalyzing functions are suitable. For example, 
for an odd N and odd L the output for the input state 
01 (the right value is the first input), has to be 1; it has 
to be for 10. Thus for all Ls and for all possible up- 
date rules the fraction of networks with a length 2 cycle 
is 2/8 = 1/4. 



5. CONCLUSIONS 

In this paper, we have investigated mainly analytically 
the effect of adding one additional link to networks con- 
sisting of one or two simple loops. There was a big differ- 
ence in the typical numbers and lengths of cycles between 
networks with a canalyzing Boolean function and net- 
works with a reversible Boolean function. For two loops 
with a cross-link, a reversible coupling function between 
the two loops leads to results very similar to those for 
two independent loops. However, a canalyzing function 
reduces the typical values of cycle length and number to 
those of a single loop. One gets an increased number of 
cycles for N\ = iVjj. For canalyzing functions one finds 
several dominant cycle lengths. 

For loops with an additional link, one of the canalyzing 
functions can freeze the entire network, while other can- 
alyzing functions produce cycles of a period up to 2A. 
The number of cycles increases exponentially with N, 
but not as fast as for simple loops. The most interesting 
finding was that a reversible function generates mean cy- 
cle lengths that increase exponentially with the network 
size. 

We thus have shown that even very simple networks 
consisting of relevant nodes with reversible couplings 
have a mean cycle length and a mean cycle number that 
increase faster than any power law in network size. On 
the other hand, canalyzing couplings tend to reduce the 
cycle length and number compared to the case where 
the additional link is absent. It will be interesting to 
see how these two contrary effects of canalyzing and re- 
versible couplings work together in more complicated rel- 
evant components of larger networks. 
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Our calculations give some indications for why it is 
so difficult to measure correct values for cycle numbers 
and lengths in computer simulations of critical Kauffman 
networks. Even for the simple components considered in 
this paper, there are cycles that can only be reached from 
a small fraction of initial conditions. For instance, in the 
case of two loops with a cross-link, many cycles have a 
frozen first loop. However, these cycles are only reached 
from initial conditions with a frozen first loop, which are 
a fraction of the order 2~ Nl of all initial conditions. Fur- 
thermore, for combinations of N 1 and N 2 , or of N and 
L, which have many common divisors, there exist par- 
ticularly large numbers of cycles. By sampling only a 
small number of initial conditions, it will never be pos- 
sible to find all these cycles. For these reasons, we have 
always performed a complete search of state space in the 
simulations reported in this paper. 



The findings of this paper teach us a third lesson: Even 
with a thorough exploration of state space, it can be dif- 
ficult to see the true asymptotic behavior of mean cycle 
numbers or sizes, as demonstrated in the case of a loop 
with an additional link and with a canalyzing coupling. 
Different contributions for different coupling functions 
and for different values of L can increase in a different 
way with N. The contribution that increases fastest will 
only dominate if N becomes very large. Only then will 
the true asymptotic behavior become visible. 

One of the main conclusions of these findings is that a 
purely numerical investigation of Kauffman networks will 
never produce reliable results. It is essential to develop 
analytical approaches that help to understand the impor- 
tant features of these systems. Up to now, there exist few 
analytical studies, and many more will be needed before 
Kauffman networks will be fully understood. 
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